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CHAPTER 4 

FOURIER SERIES AND INTEGRALS 



4.1 FOURIER SERIES FOR PERIODIC FUNCTIONS 

This section explains three Fourier series: sines, cosines, and exponentials e**"^. 

Square waves (1 or or —1) are great examples, with delta functions in the derivative. 
We look at a spike, a step function, and a ramp — and smoother functions too. 

Start with sin a;. It has period 27r since sin(x + 2tt) = sinx. It is an odd function 
since sin(— = — sinx, and it vanishes at a; = and x = n. Every function sinnx 
has those three properties, and Fourier looked at infinite combinations of the sines: 

oo 

Fourier sine series S{x) = bi sin x + 62 sin 2x + 63 sin 3x + ■ ■ ■ = b„ sin nx (1) 

11=1 

If the numbers 61 , 62 , . . . drop off quickly enough (we are foreshadowing the im- 
portance of the decay rate) then the sum S{x) will inherit all three properties: 

Periodic ^(x + 2n) = S{x) Odd S{-x) = -S{x) 5(0) = Sin) = 

200 years ago, Fourier startled the mathematicians in France by suggesting that any 
function S{x) with those properties could be expressed as an infinite series of sines. 
This idea started an enormous development of Fourier series. Our first step is to 
compute from S{x) the number b^ that multiplies sin /ex. 

Suppose S{x) = sinnx. Multiply both sides by sinfcx. Integrate from to tt: 

S{x) sin kxdx= / 61 sinxsin/cx dx + ■ ■ ■ + / 5^ sin fca; sin fca; dx + ■ ■ ■ (2) 
Jo Jo 

On the right side, all integrals are zero except the highlighted one with n = k. 
This property of "orthogonality" will dominate the whole chapter. The sines make 
90° angles in function space, when their inner products are integrals from to vr: 



Orthogonality / sinnx sinkxdx = if n^k. (3) 
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Zero comes quickly if we integrate J cos mx dx = [ 
Product of sines 



— 0. So we use this: 



1 1 

sin nx sin kx = — cos(n — k)x cos(n + k)x . 



(4) 



2 ' '2 

Integrating cos mx with m = n — k and m = n + k proves orthogonahty of the sines. 
The exception is when n = k. Then we are integrating (sin/cx)^ = ^ — icos2A;x: 



sin kx sin kx dx 



^ 1 



■ dx 



^1 , , ^ 
— cos 2kx dx = — 

2 2 



(5) 



The highhghted term in equation (2) is 6fc7r/2. Muhiply both sides of (2) by 2/7r: 



Sine coefficients 

S{-x) = -S{x) 



2 r 1 
bk = — S (x) sin kx dx = — I S{x) sin kxdx. (6) 
Ti" Jo ^ 



Notice that S{x) sinfca: is even (equal integrals from — tt to and from to tt). 

I will go immediately to the most important example of a Fourier sine series. S{x) 
is an odd square wave with SW{x) = 1 for < x < tt. It is drawn in Figure 4.1 as 
an odd function (with period 27r) that vanishes at x = and x = n. 
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Figure 4.1: The odd square wave with SW{x + 27r) = SW{x) = {1 or or —1}. 



Example 1 Find the Fourier sine coefficients bk of the square wave SW{x). 
Solution For A: = 1, 2, . . . use the first formula (6) with S{x) = 1 between and tt 
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(7) 



The even-numbered coefficients 62/c are all zero because cos2fc7r = cosO = 1. The 
odd-numbered coefficients 6^ = ^jirk decrease at the rate 1/fc. We will see that same 
1/fc decay rate for all functions formed from smooth pieces and jumps. 

Put those coefficients 4/7rfc and zero into the Fourier sine series for SW{x): 



Square wave SW{x) 



sin X sin 3x sin 5x sin 7x 



+ 



(8) 



Figure 4.2 graphs this sum after one term, then two terms, and then five terms. You 
can see the all-important Gibbs phenomenon appearing as these "partial sums" 
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include more terms. Away from the jumps, we safely approach SW{x) = 1 or 
At j; = 7r/2, the series gives a beautiful alternating formula for the number tt: 



4 

1 = - 

TT 



1 



1 

7 



so that TT 



1111 

1 ~ 3 5 ~ 7 



(9) 



The Gibbs phenomenon is the overshoot that moves closer and closer to the jumps. 
Its height approaches 1.18 .. . and it does not decrease with more terms of the series! 
Overshoot is the one greatest obstacle to calculation of all discontinuous functions 
(like shock waves in fluid flow). We try hard to avoid Gibbs but sometimes we can't. 




Figure 4.2: Gibbs phenomenon: Partial sums bnSmnx overshoot near jumps. 



Fourier Coefficients are Best 

Let me look again at the first term bi sinx = (4/7r) sinx. This is the closest possible 
approximation to the square wave SW, by any multiple of sin a; (closest in the least 
squares sense). To see this optimal property of the Fourier coefficients, minimize the 
error over all bi: 

PIT PIT 

The error is / {SW—bismx)^dx The 6i derivative is —2 / {SW— bi sin x) sin x dx. 
Jo Jo 

The integral of sin^ x is 7r/2. So the derivative is zero when bi = {2/tt) S{x) sinxdx. 
This is exactly equation (6) for the Fourier coefficient. 

Each bksinkx is as close as possible to SW{x). We can find the coefficients bk 
one at a time, because the sines are orthogonal. The square wave has 62 = because 
all other multiples of sin 2x increase the error. Term by term, we are "projecting the 
function onto each axis sinkx." 

Fourier Cosine Series 

The cosine series applies to even functions with C{—x) = C{x): 

00 

Cosine series C(2;) = ao + cos 2; + 02 cos 2a; + ■ ■ ■ = hq + a„ cosnx. (10) 

n=l 
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Every cosine has period 27r. Figure 4.3 shows two even functions, the repeating 
ramp RR{x) and the up-down train UD{x) of delta functions. Tliat sawtooth 
ramp RR is the integral of the square wave. The delta functions m UD give the 
derivative of the square wave. (For sines, the integral and derivative are cosines.) 
RR and UD will be valuable examples, one smoother than SW, one less smooth. 

First we find formulas for the cosine coefficients ag and Uk- The constant term oq 
is the average value of the function C{x): 



ao 



Average 



1 r 1 

ao = - / C{x) dx = — 
TT Jo Zn 



C{x) dx. 



fill 



I just integrated every term in the cosine series (10) from to tt. On the right side, 
the integral of is a^TT (divide both sides by tt). All other integrals are zero: 



cos nx dx 



sm nx 



n 



0-0 = 0. 



(12) 



In words, the constant function 1 is orthogonal to cosna: over the interval [0,7r]. 

The other cosine coefficients ak come from the orthogonality of cosines. As with 
sines, we multiply both sides of (10) by coskx and integrate from to tt: 



C'{x) cos kx dx 



-I ao COS kxdx+ ai cos x cos kxdx-\ h / ak(cos kx)'^ dx- 

Jo Jo Jo 



You know what is coming. On the right side, only the highlighted term can be 
nonzero. Problem 4.1.1 proves this by an identity for cos cos /cx — now (4) has a 
plus sign. The bold nonzero term is ak.Tv/2 and we multiply both sides by 2/7r: 



Cosine coefFicients 

C{-x) = C{x) 



ak 



C(x) cos kx dx 



C [x) coskx dx. (13) 



Again the integral over a full period from — tt to tt (also to 27r) is just doubled 
RR{x] = \x 




TT 27r 
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Figure 4.3: The repeating ramp RR and the up-down UD (periodic spikes) are even. 
The derivative of RR is the odd square wave SW . The derivative of SW is UD. 
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Example 2 Find the cosine coefPicients of the ramp RR{x) and the up-down UD{x). 

Solution The simplest way is to start with the sine series for the square wave: 

, 4 fsinx sinSa; sinSa; sin7x 

SW{x) = — + -— + -— + —— + ■ ■ 

TT [ 1 3 5 7 

Take the derivative of every term to produce cosines in the up-down delta function: 

4 

Up-down series UD{x) = — [cos x + cos 3x + cos 5x + cos 7x + ■ ■ ■] . (14) 

TT 

Those coefficients don't decay at all. The terms in the series don't approach zero, so 
officially the series cannot converge. Nevertheless it is somehow correct and important. 
Unofficially this sum of cosines has all I's at x = and all — I's at a; = tt. Then -|-oo 
and — oo are consistent with 26{x) and —26{x — tt). The true way to recognize 5{x) is 
by the test J S{x)f{x) dx = /(O) and Example 3 will do this. 

For the repeating ramp, we integrate the square wave series for 5*1^(2;) and add the 
average ramp height oq = n/2, halfway from to vr: 



. 1-,/ \ TT TT 

Ramp series RR(x) ~ 2 ~ ^ 



cosx cos 32; cos 5a; cos 7a: 



(15) 



The constant of integration is uq. Those coefficients drop off like They could be 

computed directly from formula (13) using J x cos kxdx, but this requires an integration 
by parts (or a table of integrals or an appeal to Mathematica or Maple). It was much 
easier to integrate every sine separately in SW{x), which makes clear the crucial point: 
Each "degree of smoothness" in the function is reflected in a faster decay rate of its 
Fourier coefficients and 6^. 



No decay Delta functions (with spikes) 

1/fe decay Step functions (with jumps) 

l/k"^ decay Ramp functions (with corners) 

decay Spline functions (jumps in /"') 

r*" decay with r < 1 Analytic functions like 1/(2 — cos a;) 



Each integration divides the fcth coefficient by k. So the decay rate has an extra 
1/k. The "Riemann-Lebesgue lemma" says that a^, and approach zero for any 
continuous function (in fact whenever J \f(x)\dx is finite). Analytic functions achieve 
a new level of smoothness — they can be differentiated forever. Their Fourier series 
and Taylor series in Chapter 5 converge exponentially fast. 

The poles of 1/(2 — cos a;) will be complex solutions of cos x = 2. Its Fourier series 
converges quickly because decays faster than any power 1/k^. Analytic functions 
are ideal for computations — the Gibbs phenomenon will never appear. 

Now we go back to 5{x) for what could be the most important example of all. 
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Example 3 Find the (cosine) coefficients of the delta function S{x), made 27r-periodic. 

Solution The spike occurs at the start of the interval [0, tt] so safer to integrate from 
— TT to TT. We find ag = l/27r and the other = I/tt (cosines because 5{x) is even): 

If" 1 If" 1 

Average qq = — / S{x) dx = — Cosines ak = — 6{x) cos kxdx = — 
27r 27r tt J_t^ tt 

Then the series for the delta function has all cosines in equal amounts: 

Delta function 6{x) = — + — [cos x + cos 2x + cos 3x + ■ ■ ■ ] . (16) 

27r TT 

Again this series cannot truly converge (its terms don't approach zero). But we can graph 
the sum after cosSa: and after cos lOx. Figure 4.4 shows how these "partial sums" are 
doing their best to approach 5{x). They oscillate faster and faster away from x = 0. 

Actually there is a neat formula for the partial sum 5n{x) that stops at cos A^x. Start 
by writing each term 2 cos 6* as e** + e~'^: 

5n = ^[1 + 2cosx + ■ ■ ■ + 2cos7Vx] = [1 + e" + e"" + ■ ■ ■ + e*^" + e"^^"] . 
27r 2tt 

This is a geometric progression that starts from er^^^ and ends at e^^^ . We have powers 
of the same factor e" . The sum of a geometric series is known: 

Partial sum ^ _ 1 e'(^+i)" - e-'(^+^)" _ 1 sm{N+\)x 

up to cos AT a; ^^^'^ ~ 27r fyix/2 _ g-ix/2 ~ 2t: sin|x " 

This is the function graphed in Figure 4.4. We claim that for any N the area underneath 
b]S!{x) is 1. (Each cosine integrated from — tt to tt gives zero. The integral of l/27r is 
1.) The central "lobe" in the graph ends when sin(Af + |)x comes down to zero, and 
that happens when (A^+ i)x = ±7r. I think the area under that lobe (marked by bullets) 
approaches the same number 1.18 . . . that appears in the Gibbs phenomenon. 

In what way does bt^{x) approach b{x)l The terms cosnx in the series jump around 
at each point x 7^ 0, not approaching zero. kx. x = -k ^nq see ^^[1 — 2 + 2 — 2 + ■ ■ ■ ] and 
the sum is l/27r or — l/27r. The bumps in the partial sums don't get smaller than 1/2?!. 
The right test for the delta function b{x) is to multiply by a smooth /(x) = ^afecosfcx 
and integrate, because we only know S{x) from its integrals J 5{x)f{x) dx = /(O): 

Weak convergence H n i \.fi \^ 1 1 ^cn\ 

of 8r,{x) to d{x) j jN{x)f{x) do. = ao + • • • + a;v - /(O) . (18) 

In this integrated sense [weak sense) the sums 5n{x) do approach the delta function ! 
The convergence of ao + ■ ■ ■ + ajv is the statement that at x = the Fourier series of a 
smooth /(x) = ^flfccosfcx converges to the number /(O). 
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Figure 4.4: The sums 5m{x) = (1 + 2 cos x + ■ ■ ■ + 2 cos Nx)/2'k try to approach 5{x) 



Complete Series: Sines and Cosines 

Over the half-period [0, vr], the sines are not orthogonal to all the cosines. In fact the 
integral of sinx times 1 is not zero. So for functions F{x) that are not odd or even, 
we move to the complete series (sines plus cosines) on the full interval. Since our 
functions are periodic, that "full interval" can be [— tt, tt] or [0,27r]: 



Complete Fourier series F{x) 



cos nx 



sm nx . 




On every "27r interval" all sines and cosines are mutually orthogonal. We find the 
Fourier coefficients and bk in the usual way: Multiply (19) by 1 and coskx and 
sinkx, and integrate both sides from — tt to tt: 



ao 



1 r 1 r 1 

F{x)dx ttk = — F{x) cos kxdx = — I F{x) sinkx dx. (20) 



27r 



Orthogonality kills off infinitely many integrals and leaves only the one we want. 

Another approach is to split F{x) = C{x) + S{x) into an even part and an odd 
part. Then we can use the earlier cosine and sine formulas. The two parts are 

C{x) = Fe.e„(x) = ^(^) +^-^(-^) s{x) = F^^^x) = (21) 

The even part gives the a's and the odd part gives the 6's. Test on a short square 
pulse from x = to x = h — this one-sided function is not odd or even. 
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Example 4 Find the as and b's if F{x) = square pulse 



1 hr < X < h 
for h< X < 27r 



Solution The integrals for and and b^. stop at x = h where F{x) drops to zero. 
The coefficients decay like 1/k because of the jump at x = and the drop at x = h: 

1 f'' h 

Coefficients of square pulse ao = — / Idx = — = average 

2n Jq 27r 

1 f'^ sinfc/i If'' 1-cosfc/i 
ttfc = — / cos kxdx = b). = — sin kxdx = . (22) 

If we divide F{x) by h, its graph is a tall thin rectangle: height ^, base /i, and area = 1. 

When h approaches zero, F[x)/h is squeezed into a very thin interval. The tall 
rectangle approaches (weakly) the delta function 6{x). The average height is area/27r = 
l/27r. Its other coefficients ak/h and bk/h approach I/tt and 0, already known for S{x): 

s ak 1 sinfc/i 1 bk 1-cosfc/i 

> oix) — = — y — and — = — > as /i ^ 0. (23) 

h ^ ' h kh TT h nkh ^ ' 

When the function has a jump, its Fourier series picks the halfway point. This 
example would converge to -F(O) = | and F{K) = |, halfway up and halfway down. 

The Fourier series converges to F(x) at each point where the function is smooth. 
This is a highly developed theory, and Carleson won the 2006 Abel Prize by proving 
convergence for every x except a set of measure zero. If the function has finite energy 
J |F(a;)p(ix, he showed that the Fourier series converges "almost everywhere." 

Energy in Function = Energy in Coefficients 

There is an extremely important equation (the energy identity) that comes from 
integrating (F(x))^. When we square the Fourier series of F{x\ and integrate from 
— TT to TT, all the "cross terms" drop out. The only nonzero integrals come from 1^ 
and cos^ kx and sin^ kx. multiplied by Hq ^-nd a^. and 6^: 

Energy in F{x) = (oq + ^ Ofc cos kx + 6fc sin kx)^dx 

(24) 

jZjF{x)ydx = 2nal + 7r(al + bl + al + bl + ---). ^ ' 

The energy in F{x) equals the energy in the coefficients. The left side is like the 
length squared of a vector, except the vector is a function. The right side comes from 
an infinitely long vector of a's and 6's. The lengths are equal, which says that the 
Fourier transform from function to vector is like an orthogonal matrix. Normalized 
by constants \/2tt and i/tt, we have an orthonormal basis in function space. 

What is this function space? It is like ordinary 3-dimensional space, except the 
"vectors" are functions. Their length ||/|| comes from integrating instead of adding: 
ll/P = / \fix)\'^dx. These functions fill Hilbert space. The rules of geometry hold: 
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Length ||/||^ = (/, /) comes from the inner product (/,<?) = / f{x)g{x) dx 
Orthogonal functions (/, (/) = produce a right triangle: ||/ + = + WqW^ 

I have tried to draw Hilbert space in Figure 4.5. It has infinitely many axes. The 
energy identity (24) is exactly the Pythagoras Law in infinite- dimensional space. 



cos kx sin x 




Figure 4.5: The Fourier series is a combination of orthonormal w's (sines and cosines). 



Complex Exponentials c^e^^^ 

This is a small step and we have to take it. In place of separate formulas for ag and Hfe 
and we will have one formula for all the complex coefficients c^. And the function 
F{x) might be complex (as in quantum mechanics). The Discrete Fourier Transform 
will be much simpler when we use complex exponentials for a vector. We practice 
in advance with the complex infinite series for a 27r-periodic function: 

Complex Fourier series 

If every c„ = c_„, we can combine e™"^ with e^™^ into 2cosnx. Then (25) is the 
cosine series for an even function. If every c„ = — c_„, we use e™^ — e~™^ = 2ismnx. 
Then (25) is the sine series for an odd function and the c's are pure imaginary. 

To find Cfc, multiply (25) by e~'^^^ (not e*''^) and integrate from — tt to tt: 




TT 



F{x)e-"'''dx = coe-"'''dx+ Cie"e-*'=^d2; + - ■ ■+ / Cke'"''^ e''"''^ dx 



The complex exponentials are orthogonal. Every integral on the right side is zero, 
except for the highlighted term (when n = k and eJ-'^^e~^'^^ = !)■ The integral of 1 is 
27r. That surviving term gives the formula for Ck- 



f 



Fourier coefficients / F{x)e dx = 2TTCk for A; = 0,±1,... (26) 
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Notice that cq = ag is still the average of F{x), because e° = 1. The orthogonality 
of e'"^ and e'^'^^ is checked by integrating, as always. But the complex inner product 
{F,G) takes the complex conjugate G of G. Before integrating, change e'^^^ to e^**^^: 



Complex inner product Orthogonality of e*"^ and e**"^ 

/TT l-TT r i(n-k)x "I 
F{x)G{x)dx / e'("-'=)"dx= - 



0, 



Example 5 Add the complex series for 1/(2 — e") and 1/(2 — e These geometric 
series have exponentially fast decay from 1/2*^. The functions are analytic. 



cos X COS 2x cos 3a: 

1 



(28) 



248yV2 48 y 2 4 \ 

When we add those functions, we get a real analytic function: 

1 1 _ (2-e-") + (2-e") _ 4-2COSX 

2-e""^2-e-"~ (2 - e")(2 - e-^^) ~5-4cos2; 

This ratio is the infinitely smooth function whose cosine coefficients are 1/2*^. 

.- I i- I- 1 r 1 ^ ■ 1- 1 -r 1 1 i^r \ f 1 for s < I < s + /i 
Example 5 Find ci, tor the 27r-periodic shitted pulse (.t = < „ , , . r ^ 

^ ^ ^ ^ [ elsewhere in [-tt, tt] 

Solution The integrals (26) from — tt to tt become integrals from s to s + h: 



s + h -1 r „-ik 



Ck = — I 1 ■ e ''''' dx = — 
2ti .Is 27r 



e 



s + h 



■ 1 _ -ikh^ 



Notice above all the simple effect of the shift by s. It "modulates" each c^ by e The 
energy is unchanged, the integral of |Fp just shifts, and all |e"''''*| = 1: 

Shift F{x) to F{x-s)< > Multiply by e-''''. (30) 

Example 7 Centered pulse with shift s = —h/2. The square pulse becomes centered 
around x = 0. This even function equals 1 on the interval from —h/2 to h/2: 



Centered by s = — - c^. 



1 sin(fc/i/2) 



2 27rzA; 27r fc/2 

Divide by h for a tall pulse. The ratio of sin(fc/i/2) to kh/2 is the sine function: 

Tall pulse = ^ V sine f ^) = | ^ " ^/^.^ ^ 

/i 27r V 2 / 10 elsewhere in — 7r,7r 

That division by h produces area = 1. Every coefficient approaches ^ as /i — > 0. 

The Fourier series for the tall thin pulse again approaches the Fourier series for 5{x). 
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Hilbert space can contain vectors c = (cq, Ci, c_i, C2, c_2, ■ ■ ■ ) instead of functions 
F{x). The length of c is 27r^ |cfep = J \F\^dx. The function space is often denoted 
by and the vector space is The energy identity is trivial (but deep). Integrating 
the Fourier series for F{x) times F{x), orthogonality kills every c„Cfc for n ^ k. This 
leaves the c^Cfc = IcfeP: 



/TT 
7 



\F{x)\^dx = r c„e»^)(5] c^e-'^-)dx = 27r(|cop + \c,\^ + \c^i\^ + ••) . (31) 

J —7T 



This is Plancherel's identity: The energy in x-space equals the energy in k-space. 
Finally I want to emphasize the three big rules for operating on F{x) = ^ CkC^'"^: 

dF 

1. The derivative — has Fourier coefficients ikck (energy moves to high k). 

dx 

2. The integral of F{x) has Fourier coefficients t^,A; ^ (faster decay). 

3. The shift to F{x — s) has Fourier coefficients e^^'^^Ck (no change in energy). 



Application: Laplace's Equation in a Circle 

Our first application is to Laplace's equation. The idea is to construct u{x,y) as an 
infinite series, choosing its coefficients to match uo{x,y) along the boundary. Every- 
thing depends on the shape of the boundary, and we take a circle of radius 1. 

Begin with the simple solutions 1, r cos 9, r sin 6, cos 26, r^ sin 26, ... to Laplace's 
equation. Combinations of these special solutions give all solutions in the circle: 



u{r, 6) = ao + air cos 6 + bir sin 6 + a2r^ cos 261 + b2r^ sin 20 H (32) 

It remains to choose the constants aj. and to make u = uq on the boundary. 
For a circle uo{6) is periodic, since 6 and 9 + 2Tr give the same point: 

Set r = 1 uo{6) = ao + Oi cos 6 + bi sin 6 + a2 cos 26 + 62 sin 20 + ■ ■ ■ (33) 

This is exactly the Fourier series for uq. The constants a^ and bk must be the 
Fourier coefficients of uq{6). Thus the problem is completely solved, if an infinite 
series (32) is acceptable as the solution. 

Example 8 Point source uq = 6{6) at 6 = The whole boundary is held at uq = 0, 
except for the source at x = 1, ?/ = 0. Find the temperature u{r,6) inside. 

11 1 °° 

Fourier series for 5 uo{6) = h - (cos + cos 20 + cos 30 H ) = — "S^ e"" 

2n IT 2tt ^ — ' 

—00 
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Inside the circle, each cosnO is multiplied by r": 

Infinite series for u u{r, 6) = — + —{r cos6 + r'^ cos26 + cos36 + ■■ ■) (34) 

Poisson managed to sum this infinite series! It involves a series of powers of re^^. 
So we know the response at every (r, 6) to the point source at r = 1, ^ = 0: 



Temperature inside circle u(r. 6) = (35) 

ZTT 1 + — 2r cos 

At the center r = 0, this produces the average of uq = 5{6) which is ao = l/27r. On the 
boundary r = 1, this produces u = except at the point source where cosO = 1: 

1 l-r^ 11 + r 

On the ray 61 = uir, 9) = = . (36) 

' ^ ' ^ 27r 1 + r2 - 2r 27r 1 - r ^ ^ 

As r approaches 1, the solution becomes infinite as the point source requires. 



Example 9 Solve for any boundary values uq{6) by integrating over point sources. 

When the point source swings around to angle ip, the solution (35) changes from 6 to 
9 — ip. Integrate this "Green's function" to solve in the circle: 



Poisson's formula u{r, t 



1 

2tt 



Uo{(p) 



l-r2 



1 + — 2r cos(0 — p) 



dip 



(37) 



Ar r = the fraction disappears and u is the average J UQ{p})dip/2TT. The steady 
state temperature at the center is the average temperature around the circle. 

Poisson's formula illustrates a key idea. Think of any uo{9) as a circle of point sources. 
The source at angle p = 9 produces the solution inside the integral (37). Integrating 
around the circle adds up the responses to all sources and gives the response to uo{9). 



Example 10 Uo{9) = 1 on the top half of the circle and uq = —1 on the bottom half. 
Solution The boundary values are the square wave SW{9). Its sine series is in (8): 



Square wave for Uo{9) SW{9) 



sin 9 sin 36* sin 59 



1 



(38) 



Inside the circle, multiplying by r, r , r\... gives fast decay of high frequencies: 



Rapid decay inside u{r, i 



r sin 9 r'^ sin 3^ sin 59 
— : h h 



(39) 



Laplace's equation has smooth solutions, even when uq{9) is not smooth. 
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■ WORKED EXAMPLE ■ 

A hot metal bar is moved into a freezer (zero temperature). The sides of the bar 
are coated so that heat only escapes at the ends. What is the temperature u{x, t) 
along the bar at time t? It will approach m = as all the heat leaves the bar. 

Solution The heat equation is Uf = u^x- At i = the whole bar is at a constant 
temperature, say u=l. The ends of the bar are at zero temperature for all time t>0. 
This is an initial-boundary value problem: 

Heat equation Ut = u^x with u{x, 0) = 1 and u(0, t) = u{tt, t) = 0. (40) 
Those zero boundary conditions suggest a sine series. Its coefficients depend on t: 

oo 

Series solution of the heat equation u{x,t) = ^^6„(i) sinnx. (41) 

1 

The form of the solution shows separation of variables. In a comment below, we 
look for products A{x) B{t) that solve the heat equation and the boundary conditions. 
What we reach is exactly A[x) = sinnx and the series solution (41). 

Two steps remain. First, choose each bn{t) sinna: to satisfy the heat equation: 
Substitute into Ut = u^x 6,'(i)sinna; = —n'^bn{t) sinnx &„(t) = e""^*6„(0). 

Notice 6^ = —v?hn- Now determine each 6„(0) from the initial condition u[x,{)) = 1 
on (0,7r). Those numbers are the Fourier sine coefficients of SW{x) in equation (38): 



Box function/square wave > bn(0) sinn.i; = 1 b„{0) = — for odd n 

^-^ Tin 
1 

This completes the series solution of the initial-boundary value problem: 
Bar temperature u{x,t) = —e^"^* sinnx. (42) 

odd n 

For large n (high frequencies) the decay of e~"^* is very fast. The dominant term 
(4/7r)e~' sinx for large times will come from n = 1. This is typical of the heat 
equation and all diffusion, that the solution (the temperature profile) becomes very 
smooth as t increases. 

Numerical difficulty I regret any bad news in such a beautiful solution. To compute 
u{x,t), we would probably truncate the series in (42) to N terms. When that finite 
series is graphed on the website, serious bumps appear in UN{x,t). You ask if there 
is a physical reason but there isn't. The solution should have maximum temperature 
at the midpoint x = tt/2, and decay smoothly to zero at the ends of the bar. 
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Those unphysical bumps are precisely the Gibbs phenomenon. The initial 
u{x, 0) is 1 on (0, tt) but its odd reflection is —1 on (— tt, 0). That jump has produced 
the slow A/nn decay of the coefRcients, with Gibbs oscillations near x = and x = n. 
The sine series for u{x, t) is not a success numerically. Would finite differences help? 

Separation of variables We found hn{t) as the coefficient of an eigenfunction sin nx. 
Another good approach is to put u = A{x) B{t) directly into ut = Uxx- 

A"(x) B'it) 

Separation A{x) B'{t) = A"{x) B{t) requires = = constant. (43) 

A" /A is constant in space, B' / B is constant in time, and they are equal: 
A" B' 

= —A gives A = smVXx and cos a/A x — = —A gives B = e~^* 

A B 

The products AB = e"'^* sin-\/Ax and e"'^* cos\^x solve the heat equation for any 
number A. But the boundary condition u{0, t) = eliminates the cosines. Then 
u(Tr, t) = requires A = = 1, 4, 9, ... to have sin ^/Xtt = 0. Separation of variables 
has recovered the functions in the series solution (42). 

Finally u{x, 0) = 1 determines the numbers 4/Trn for odd n. We find zero for even 
n because smnx has n/2 positive loops and n/2 negative loops. For odd n, the extra 
positive loop is a fraction 1/n of all loops, giving slow decay of the coefficients. 

Heat bath (the opposite problem) The solution on the website is 1 — u{x,t), 
because it solves a different problem. The bar is initially frozen at U{x, 0) = 
0. It is placed into a heat bath at the fixed temperature U = 1 {or U = To). 
The new unknown is U and its boundary conditions are no longer zero. 

The heat equation and its boundary conditions are solved first by Usixji). In 
this example = 1 is constant. Then the difference V = U — Ub has zero boundary 
values, and its initial values are V = —1. Now the eigenfunction method (or sepa- 
ration of variables) solves for V. (The series in (42) is multiplied by —1 to account 
for V{x,0) = —1.) Adding back Ub solves the heat bath problem: U = Ub + V = 
1 — u{x, t). 

Here (7^ = 1 is the steady state solution at t = oo , and V is the transient solution. 
The transient starts at F = — 1 and decays quickly to F = 0. 

Heat ba,th at one end The website problem is different in another way too. The 
Dirichlet condition uiir^t) = 1 is replaced by the Neumann condition u'(l,i) = 0. 
Only the left end is in the heat bath. Heat flows down the metal bar and out at the 
far end, now located at a; = 1. How does the solution change for fixed- free? 

Again J7b = 1 is a steady state. The boundary conditions apply ioV = 1 — Ub'- 



Fixed-free ^ ^ ^ ^ ^, ^ ^ ^^^^ ^ ^.^ {n+-\ ttx. (44) 

eigenfunctions \ 2/ 
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Those eigenfunctions give a new form for the sum of An{x): 
Fixed-free solution V{x, t) = S„(0) £-("+5)"'^"' sin (n + -\ nx. (45) 

oddn ^ ^ 

An frequencies shift by ^ and multiply by tt, because A" = —XA has a free end 
at a; = 1. The crucial question is: Does orthogonality still hold for these new 
eigenfunctions sin (n + i) ttj; on [0,1]? The answer is yes because this fixed-free 
"Sturm-Liouville problem" A" = —XA is still symmetric. 

Summary The series solutions all succeed but the truncated series all fail. We can 
see the overall behavior of u{x,t) and V{x,t). But their exact values close to the 
jumps are not computed well until we improve on Gibbs. 

We could have solved the fixed- free problem on [0, 1] with the fixed- fixed solution 
on [0,2]. That solution will be symmetric around a; = 1 so its slope there is zero. 
Then rescaling x by 27r changes sin(n + ^)'kx into sin(2n + 1)2;. I hope you like the 
graphics created by Asian Kasimov on the cse website. 

Problem Set 4.1 

1 Find the Fourier series on — tt < a: < tt for 

(a) f[x) = sin'^ x, an odd function 

(b) f{x) = I sin a; I, an even function 

(c) f{x) = x 

(d) f[x) = e^, using the complex form of the series. 

What are the even and odd parts of f{x) = and f{x) = e"? 

2 From Parseval's formula the square wave sine coefficients satisfy 

/7r PIT 
\f{x)\'^dx= / ldx = 2TT. 

Derive the remarkable sum 7r^ = 8(l-|-| + ^-|----). 

3 If a square pulse is centered at a; = to give 

TT TT 

f{x) = 1 for |a;| < —,f[x) = for — < < tt, 
draw its graph and find its Fourier coefficients Ofe and bk- 

4 Suppose / has period T instead of 2x, so that f(x) = f{x + T). Its graph from 
— T/2 to r/2 is repeated on each successive interval and its real and complex 
Fourier series are 

fix) = ao ai COS — -h 6i sin — -h ■ ■ ■ = Cfe e''^^^^/^ 

—00 

Multiplying by the right functions and integrating from —T/2 to T/2, find a^, 
bk, and c^. 
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Plot the first three partial sums and the function itself: 
8 / sinx sin3x sin 5a; \ 

Why is the decay rate for this function? What is the second derivative? 

What constant function is closest in the least square sense to / = cos^ x7 What 
multiple of cos x is closest to / = cos^ x? 

Sketch the 27r-periodic half wave with f{x) = sinx for < a; < tt and f{x) = 
for —IT < X < 0. Find its Fourier series. 

(a) Find the lengths of the vectors u = (1, |, |, |, • • •) and v = (1, |, |, • • ■) in 
Hilbert space and test the Schwarz inequality ju'^up < {u^u){v'^v). 

(b) For the functions / = 1 + |e" + ie^'"^ + ■ • • and 5 = 1 + ^e" + ^e^" + ■•• 
use part (a) to find the numerical value of each term in 

rj{x)g{x)dx < r \f{x)\^dx r i^wrd^. 

J —TT J —TT J —77 

Substitute for / and g and use orthogonality (or Parseval). 

9 Find the solution to Laplace's equation with uq = on the boundary. Why is 
this the imaginary part of 2{z — + ■ ■ ■ ) =2 log(l + z)7 Confirm that 
on the unit circle z = e*^, the imaginary part of 21og(l + z) agrees with 9. 

10 If the boundary condition for Laplace's equation is Wq = 1 for < ^ < tt and 
Uq = for — TT < 9 < 0, find the Fourier series solution u{r, 9) inside the unit 
circle. What is u at the origin? 

11 With boundary values ^0(6*) = 1 + |e*^ + \e^^^ + • • • , what is the Fourier series 
solution to Laplace's equation in the circle? Sum the series. 

12 (a) Verify that the fraction in Poisson's formula satisfies Laplace's equation. 

(b) What is the response zi(r, 9) to an impulse at the point (0, 1), at the angle 
if = 7r/2? 

(c) If Wo (9?) = 1 in the quarter-circle < < 7r/2 and uo = elsewhere, show 
that at points on the horizontal axis (and especially at the origin) 

2^ 



/ 



1 1 _ /l-r^\ 



dip 1 , / \/&^ — sin (p 

^ - : tan"^ ' ^ 



b + c cos i/P^^c^ V c + b cos </? 
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13 When the centered square pulse in Example 7 has width h = n, find 

(a) its energy J dx by direct integration 

(b) its Fourier coefficients Ck as specific numbers 

(c) the sum in the energy identity (31) or (24) 

If /i = 27r, why is Cq = 1 the only nonzero coefficient ? What is F{x)7 

14 In Example 5, F{x) = l + (cosa:;)/2H h (cosna;)/2"H is infinitely smooth: 

(a) If you take 10 derivatives, what is the Fourier series of d^°F/dx^°7 

(b) Does that series still converge quickly? Compare with 2" for n^"^^. 

15 {A touch of complex analysis) The analytic function in Example 5 blows up 

when 4 cos a; = 5. This cannot happen for real x, but equation (28) shows 
blowup if = 2 or i. In that case we have poles at x = ±ilog2. Why are 
there also poles at all the complex numbers x = ±i log 2 + 27rn ? 

15 {A second touch) Change 2's to 3's so that equation (28) has 1/(3 — e") + 
1/(3 — e~'^). Complete that equation to find the function that gives fast decay 
at the rate 1/3*^. 

17 {For complex professors only) Change those 2's and 3's to I's: 

1 1 _ (1 - e"'^) + (1 - e") _ 2 - e'^ - e"'^ _ ^ 

A constant ! What happened to the pole at e" = 1 ? Where is the dangerous 
series (1 + e*^ H ) + (1 + e~*^ H ) = 2 + 2 cos a; H involving 5{x) ? 

18 Following the Worked Example, solve the heat equation Ut = u^^ from a point 
source u{x,0) = S{x) with free boundary conditions u'{Tr,t) = u'{—Tr,t) = 0. 
Use the infinite cosine series for d{x) with time decay factors bn{t). 



